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A typing recognition apparatus for touch typing on surfaces with limited 
tactile feedback that compensates for finger and hand drift during typing 
and discourages any integrated spelling model from choosing dictionary 
words over unusual but carefully typed strings, the apparatus comprising: 

a typing surface means that displays symbols indicating the locations 

of touchable keys; 

touch sensor means that provides the surface coordinates of each 
touch by a typist attempting to strike said key symbols on said 
surface; 

hypothesis tree generator means that extends existing key hypothesis 
sequences with hypotheses for keys in the neighborhood of each new 
touch; 

pattern geometry evaluation means that computes geometry match 
metrics for the hypothesized key sequences by comparing separation 
vectors between the successive touch locations with separation vectors 
between the successively hypothesized key locations as well as by 
measuring the zero-order key/touch alignment error; 
decoding means that finds the hypothesized key sequence with the 
best cumulative match metric; and, 

transmission means for communicating the symbols and commands 
represented by the best hypothesized key sequence to host computer 
applications. 

The apparatus of claim ]_wherein a synchronization detection means inserts 
resting finger hypothesis into the hypothesis tree upon detection of a hand 
resting substantially on home row, and wherein said resting hypotheses are 
given for key separation vector computation purposes the coordinates of the 
home row key that their touch's identified finger normally rests upon. 

The apparatus of claim 1_wherein a stack decoder is utilized as the particular 
decoding means. 
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The apparatus of claim 1 wherein the geometry match metric for a 
hypothesized key is substantially formulated as the squared distance 
between a touch and its hypothesized key plus the sum of squared 
differences between corresponding key and touch separation vectors of all 
valid orders. 

The apparatus of claim 4 wherein the difference between a touch separation 
vector and the corresponding key separation vector is weighted in roughly 
inverse proportion to the touch time difference between the two touches 
from which the touch separation vector was computed. 

The apparatus of claim 4 wherein the difference between a touch separation 
vector and the corresponding key separation vector is weighted less if the 
touch separation vector is large. 
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A method for recognizing typing from typing devices that sense lateral finger 
position but provide limited tactile feedback of key location, the method 
advantageously compensating for finger and hand drift during typing and 
discouraging any integrated spelling model from choosing dictionary words 
over unusual but carefully typed strings, wherein the method comprises the 
following steps: 

forming a touch location and time sequence from the fingertip 
position at the end of each keystroke as measured by typing sensors; 
computing a set of touch separation vectors of increasing orders from 
the location difference between the newest touch and previous touch 
in said touch location sequence; 

generating a set of key hypothesis sequences for the given touch 
sequence, each hypothesis in a sequence being for a key near the 
location of the touch causing the hypothesis; 

for each key hypothesis, computing a set of key separation vectors of 
increasing orders from differences between the position of the newest 
key and previous keys in the hypothesized sequence; 
for each key hypothesis, computing a geometry match metric as a 
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function of the magnitude of the zero-order touch/key alignment 
error as well as of the magnitudes of each order's touch and key 
separation vector difference; 

combining the geometry match metrics from each hypothesis in a key 
hypothesis sequence into a cumulative match metric for the hypothesis 
sequence; 

choosing the hypothesized key sequence with the best cumulative 
metric as the best hypothesized key sequence; and, 
transmitting the symbols and commands represented by the best 
hypothesized key sequence to a host computer for further action. 

The method of claim 7 wherein the magnitude of each difference between a 
touch separation vector and the corresponding key separation vector is 
weighted in roughly inverse proportion to the time between the two touches 
from which the touch separation vector was computed, 

The method of claim 7 wherein the magnitude of each difference between a 
touch separation vector and the corresponding key separation vector is 
weighted less if the touch separation vector is large. 

The method of claim 7 wherein a synchronization detection means inserts 
resting finger hypothesis into the hypothesis tree upon detection of a hand 
resting substantially on home row, and wherein said resting hypotheses are 
given for key separation vector computation purposes the coordinates of the 
home row key that their touch's identified finger normally rests upon. 

The method of claim 7 wherein the set of key hypothesis sequences are 
stored as a hypothesis tree that can extend the sequences upon reception of 
a new touch by sprouting new hypotheses. 
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The method of claim 1 1 wherein a stack decoder is utilized to find the best 
hypothesized key sequence. 
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A method for recognizing typing from typing devices that sense lateral finger 
position but provide limited tactile feedback of key location, the method 
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advantageously compensating for finger and hand drift during typing and 
discouraging any integrated spelling model from choosing dictionary words 
over unusual but carefully typed strings, wherein the method comprises the 
following steps: 

forming a touch location and time sequence from the fingertip 
position at the end of each keystroke as measured by typing sensors; 
generating a set of key hypothesis sequences for the given touch 
sequence, each hypothesis in a sequence being for a key near the 
location of the touch causing the hypothesis; 

for each key hypothesis, computing a key/touch alignment error vector 
as the difference between the location of the hypothesized key and the 
location of its causing touch; 

for each key hypothesis, computing a geometry match metric as a 
function of the magnitude of the hypothesis' key/touch alignment 
error as well as of the magnitude of differences between the 
hypothesis' key/touch alignment error vector and that of preceding 
hypotheses in its sequence; 

combining the geometry match metrics from each hypothesis in a key 
hypothesis sequence into a cumulative match metric for the hypothesis 
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sequence; 

choosing the hypothesized key sequence with the best cumulative 
metric as the best hypothesized key sequence; and, 
transmitting the symbols and commands represented by the best 
hypothesized key sequence to a host computer for further action. 

The method of claim 1 3 wherein the magnitude of the difference between 
two hypotheses' key/touch alignment error vectors is weighted in roughly 
inverse proportion to the time between the two touches from which the 
touch separation vector was computed. 
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The method of claim 1 3 wherein the magnitude of the difference between 
two hypotheses' key/touch alignment error vectors is weighted less if the 
separation between the corresponding touches is large. 
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[c16] The method of claim 13 wherein a synchronization detection means inserts 

resting finger hypothesis into the hypothesis tree upon detection of a hand 
resting substantially on home row, and wherein said resting hypotheses are 
given for key/touch alignment error vector computation purposes the 
coordinates of the home row key that their touch's identified finger normally 
rests upon. 

[cl 7] The method of claim 1 3 wherein the set of key hypothesis sequences are 

stored as a hypothesis tree that can extend the sequences upon reception of 
a new touch by sprouting new hypotheses. 

The method of claim 1 7 wherein a stack decoder is utilized to find the best 
hypothesized key sequence. 
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